From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-12.5 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, INCLUDES_CR_TRAILER,MAILING_LIST_MULTI,NICE_REPLY_A,SPF_HELO_NONE,SPF_PASS, URIBL_BLOCKED,USER_AGENT_SANE_1 autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 7ED02C433DB for ; Wed, 20 Jan 2021 15:49:31 +0000 (UTC) Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 15F4023340 for ; Wed, 20 Jan 2021 15:49:31 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 15F4023340 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=redhat.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Received: from localhost ([::1]:38358 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1l2Fjc-0002FH-PI for qemu-devel@archiver.kernel.org; Wed, 20 Jan 2021 10:49:30 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:50988) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1l2Fgq-0007hj-8I for qemu-devel@nongnu.org; Wed, 20 Jan 2021 10:46:37 -0500 Received: from us-smtp-delivery-124.mimecast.com ([63.128.21.124]:39896) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.90_1) (envelope-from ) id 1l2Fgn-0000Eg-9A for qemu-devel@nongnu.org; Wed, 20 Jan 2021 10:46:36 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1611157592; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=iuZP53eCMK/AW+42NvhdT0ZvPdZ7g9Vxcf/1yNuZoUY=; b=Ck4JLV5WKqbD5hB22YbTAjNETmRY/vkW2f6tisqS9dGvq5mtWsDLCabhR5ueCvlQFFDQzk 1h3+Puuy6/UVpf02kxdKaeUf/tlu5TwzwmZ/EOFNIFAncZKflWmBHxvV2u5eBes1hVxazp ea7az5RP7bX8cZ93jdrVRA6n8VdQGNw= Received: from mimecast-mx01.redhat.com (mimecast-mx01.redhat.com [209.132.183.4]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-78--uNbYnFPMzmCe7cWFzwPdg-1; Wed, 20 Jan 2021 10:46:30 -0500 X-MC-Unique: -uNbYnFPMzmCe7cWFzwPdg-1 Received: from smtp.corp.redhat.com (int-mx03.intmail.prod.int.phx2.redhat.com [10.5.11.13]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx01.redhat.com (Postfix) with ESMTPS id 1A46F801817; Wed, 20 Jan 2021 15:46:29 +0000 (UTC) Received: from [10.10.120.151] (ovpn-120-151.rdu2.redhat.com [10.10.120.151]) by smtp.corp.redhat.com (Postfix) with ESMTP id 8633D6B8DA; Wed, 20 Jan 2021 15:46:28 +0000 (UTC) Subject: Re: [PATCH] qmp-shell: Suppress banner and prompt when stdin is not a TTY To: =?UTF-8?Q?Daniel_P=2e_Berrang=c3=a9?= , Dov Murik References: <20210117072742.119377-1-dovmurik@linux.vnet.ibm.com> <1d63a097-27d5-5b3a-2ce6-f6a2402e135e@linux.vnet.ibm.com> <20210120094539.GC3015589@redhat.com> From: John Snow Message-ID: <0d56a477-d4dd-ca59-9b16-90ea8c7a1c45@redhat.com> Date: Wed, 20 Jan 2021 10:46:27 -0500 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.6.0 MIME-Version: 1.0 In-Reply-To: <20210120094539.GC3015589@redhat.com> X-Scanned-By: MIMEDefang 2.79 on 10.5.11.13 Authentication-Results: relay.mimecast.com; auth=pass smtp.auth=CUSA124A263 smtp.mailfrom=jsnow@redhat.com X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit Received-SPF: pass client-ip=63.128.21.124; envelope-from=jsnow@redhat.com; helo=us-smtp-delivery-124.mimecast.com X-Spam_score_int: -30 X-Spam_score: -3.1 X-Spam_bar: --- X-Spam_report: (-3.1 / 5.0 requ) BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.167, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, NICE_REPLY_A=-0.094, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H4=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: qemu-devel@nongnu.org, Markus Armbruster Errors-To: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Sender: "Qemu-devel" On 1/20/21 4:45 AM, Daniel P. Berrangé wrote: > On Wed, Jan 20, 2021 at 10:25:25AM +0200, Dov Murik wrote: >> Hi John, >> >> On 19/01/2021 22:02, John Snow wrote: >>> On 1/17/21 2:27 AM, Dov Murik wrote: >>>> Detect whether qmp-shell's standard input is not a TTY; in such case, >>>> assume a non-interactive mode, which suppresses the welcome banner and >>>> the "(QEMU)" prompt.  This allows for easier consumption of qmp-shell's >>>> output in scripts. >>>> >>>> Example usage before this change: >>>> >>>>      $ printf "query-status\nquery-kvm\n" | sudo >>>> scripts/qmp/qmp-shell qmp-unix-sock >>>>      Welcome to the QMP low-level shell! >>>>      Connected to QEMU 5.1.50 >>>> >>>>      (QEMU) {"return": {"status": "running", "singlestep": false, >>>> "running": true}} >>>>      (QEMU) {"return": {"enabled": true, "present": true}} >>>>      (QEMU) >>>> >>>> Example usage after this change: >>>> >>>>      $ printf "query-status\nquery-kvm\n" | sudo >>>> scripts/qmp/qmp-shell qmp-unix-sock >>>>      {"return": {"status": "running", "singlestep": false, >>>> "running": true}} >>>>      {"return": {"enabled": true, "present": true}} >>>> >>>> Signed-off-by: Dov Murik >>> >>> Hiya! I've been taking lead on modernizing a lot of our python >>> infrastructure, including our QMP library and qmp-shell. >>> >>> (Sorry, not in MAINTAINERS yet; but I am in the process of moving these >>> scripts and tools over to ./python/qemu/qmp.) >> >> Thanks for this effort. >> >>> >>> This change makes me nervous, because qmp-shell is not traditionally a >>> component we've thought of as needing to preserve backwards-compatible >>> behavior. Using it as a script meant to be consumed in a headless >>> fashion runs a bit counter to that assumption. >>> >>> I'd be less nervous if the syntax of qmp-shell was something that was >>> well thought-out and rigorously tested, but it's a hodge-podge of >>> whatever people needed at the moment. I am *very* reluctant to cement >>> it. >> >> Yes, I understand your choice. >> >> >>> >>> Are you trying to leverage the qmp.py library from bash? >> >> Yes, I want to send a few QMP commands and record their output. If I use >> socat to the unix-socket I need to serialize the JSON request myself, so >> using qmp-shell saves me that; also not sure if there's any negotiation done >> at the beginning by qmp-shell. > > There is a handshake, but it is just a single json message. > > See docs/interop/qmp-intro.txt and qmp-spec.txt for guidance. > >> Is there an easier way to script qmp commands, short of writing my own >> python program which uses the qmp.py library? > > Yes, writing your own python program is probably best. Doing anything > complex is shell is almost always a mistake, as it is a very crude > and poor language compared to something like managing QEMU/QMP. > > Note that I don't believe that we've declared qmp.py to be a long > term stable interface for users outside of QEMU either. An alternative > is to just use the python sockets APIs directly to speak to QEMU/QMP > Right. qmp.py is technically not stable either, but it at least doesn't use an invented syntax we don't have a spec for ... and it is used by quite a few other things in the tree, so I trust it /slightly/ more. I cannot promise compatibility for scripts that aren't in the tree at this time, though. (I am working on an asyncio variant of the QMP library that I do hope to promise stability for, but that's probably not something you can hope to see in the short term. It will likely have an API that is at least somewhat similar to the existing library, but will use asyncio coroutines instead of blocking calls.) You can look at ./tests/qemu-iotests/ for some examples of using the QMP library that we have today; grep for '.qmp(' to find examples. The connection for these tests is established in python/qemu/machine.py, look at the 'self._qmp_connection' field. This connection is exposed via the qmp(...) method, which the tests use. The library handles the (very small) handshake. There are also bash tests in ./tests/qemu-iotests/ that handle some QMP by themselves, and might be up your alley for very simple cases. Test 060 sets up its own QMP connection and just echoes JSON into the pipe. --js